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FIGURE  1 


In  a general  n (>_  2)  echelon  maintenance  system,  the  highest  echelon 
(level  n)  is  a lone  installation  referred  to  as  the  depot.  Primary  demands 
for  reparable  items  occur  only  at  the  lowest  level  (level  1)  installations. 
Depending  on  the  nature  of  the  repair  required,  the  failed  unit  is  either 
repaired  at  the  level  1 installation  to  which  it  has  been  brought  or  is  sent 
to  a higher  level  location.  At  the  higher  level  location,  a decision  is  again 
made  whether  to  repair  the  item  there  or  to  send  the  item  to  a higher  echelon 
location  for  repair.  All  items  received  at  the  depot  are  repaired  there. 

We  assume  that  each  time  a decision  is  made  on  an  item  it  is  made  indepen- 
dently of  the  decisions  on  other  items.  In  many  practical  multi-echelon 
inventory  systems,  a level  k location  can  send  a failed  item  only  to  a level 
krt-1  location  if  it  does  not  repair  the  item  at  its  own  repair  facility. 

In  either  case  we  shall  assume  that  all  resupply  is  done  on  a one  for 
one  basis j that  is,  a continuous  review  (S-1,S)  policy  is  followed.  When  a 
failed  unit  is  sent  to  a higher  level  location  for  repair,  the  higher  level 
location  must  resupply  the  lower  level  location  with  a serviceable  unit 
when  one  is  available  for  shipment. 

2 


3 


■ order  and  ship  time  between  i and  level  k location  g which 

is  the  unique  level  k location  from  which  i seeks  resupply. 

" delay  at  level  k location  g due  to  the  unavailability  of 
serviceable  stock. 

**  probability  that  a failed  item  is  repaired  at  i 
n 

- 1 - Z r(i,k)  - r(i, j ) 
k-J+1 

i By  definition  TN+^  = Tq  » Rq  - depot  repair  cycle  time. 

The  expected  delay  D is  given  by 

S 

k expected  number  of  backorders  outstanding  at  a point  in 

C = time  at  level  k location  g 

8 average  yearly  demand  at  level  k location  g 

Let  N(g,k)  ■ unique  set  of  lower  level  installations  that  receive  their 
resupply  from  level  k location  g when  requesting  resupply  from  a level  k 
location,  k 2.  Then  Xg  - average  yearly  demand  at  this  installation  is 
given  by 

(2)  X - Z r(j,k)  X,  g - m + 1 N+l 

8 jeN(g.k)  J 

If  Sg  = stock  level  at  installation  g then  the  expected  backorders  at  a 
point  in  time  at  this  Installation  is  given  by 

(3)  Z (x-S  ) P(x| X T ) 

x>S  « 8 8 

g 

where 

P(x|x  T ) =*  probability  that  x units  are  in  resupply  at  location  g 
g g 

given  a lead  time  demand  of  X T . 

g g 
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The  overall  problem  we  consider  then  is 


(4)  Min  Z = C S + E C^S  + Cg  (E  ( E (x-Sk>p  (x  | X^) ) ) 

j-1  J k-1  x>Sk 

where 

Cu  = annual  holding  cost  per  unit 
n 

C_  = backorder  cost  per  unit  year  backordered 

D 

S - depot  stock 
o 

Z is  generally  not  a convex  function  so  that  optimization  is  not 
straightforward.  Proposed  solution  schemes  generally  involve  explicitly 
examining  different  possible  stock  levels  in  order  to  find  the  optimal 
solution.  Hence,  it  is  of  paramount  importance  to  be  able  to  bound  the 
value  of  the  optimal  stock  levels  at  the  various  locations  so  that  as  few 
stock  levels  as  possible  need  to  be  explicitly  examined. 

2.  Computational  Bounds 

In  this  section  we  derive  some  useful  bounds  on  the  values  of  the 
optimal  stock  levels.  Muckstadt  [3]  reported  on  some  empirical  bounds  for 
a problem  very  similar  to  (4)  for  four  echelons.  His  bounds  were  based 
on  observe  ms  of  optimal  stock  levels.  Kruse  [2]  developed  some  theore- 
tical results  for  (4)  in  a two  echelon  case.  His  results  can  be  seen  to 
be  special  cases  of  some  of  the  results  derived  here. 

Consider  problem  (4).  If  the  depot  stock,  So,  is  fixed  at  some 
value  y,  solving  (4)  with  S - y is  equivalent  to  solving  the  n-1  echelon  problem. 


(5)  Min  TCL(y)  - E CgS  + Cfi(E  ( “s  (x-sk>p(x|  X^) ) ) 

j-1  3 k-1  k 

* 

Note  Z - C y + TCL(y).  Let  TCL  (y)  be  the  minimum  total  cost  at  the  n-1 
n 

lower  echelons  when  Sq  = y.  This  is  obtained  by  solving  (5)  with  Sq  - y. 

Then  problem  (4)  can  be  restated  as 

(6)  Min  TC (S  ) - C„S  + TCL*(S  ) 

O H 0 O 


So  - 0,  1,  2,, 


r 


Let  TCL  (®)  = optimal  cost  at  the  lower  echelons  when  there  is  never  a 
delay  at  the  depot  due  to  unavailable  serviceable  stock 
when  resupply  is  requested  by  a lower  echelon  location.  The  following 
Lemma  is  the  crux  of  our  major  results. 

* * 

Lemma:  Let  j < k.  Then  TCL  (j)  > TCL  (k) 

“l 

Proof:  Let  B(S,T)  = T.  ( I (x-S  )p(x|)lT  )) 

k-1  x>S,  K K * 

k 

* 

This  is  an  increasing  function  of  T^.  Let  S (j)  be  the 

optimal  lower  echelon  stock  levels  when  S ' j . By  maintaining  the  same 

0 * 

stock  levels  when  Sq  = k,  the  optimal  lower  echelon  cost,  TCL  (k)  cannot 

increase  since  the  holding  cost  at  the  lower  echelons  remains  the  same  but 

backorder  costs  will  not  increase  since  T,  , k **  l,...,m„ 

k 1,  cannot  increase  by 

adding  more  stock  at  the  depot.  Hence,  by  setting  S ® k > j we  can  at  least 
do  as  well  at  the  lower  echelons  as  when  Sq  = j . Hence,  TCL  (j)  > TCL  (k) . 

* 

Let  =■  value  of  the  depot  stock  in  an  optimal  solution  to  (4) . 

(7)  Theore.  1:  S*  < TCL*t.)  , 

° “ CH 


where  [x]  denotes  the  largest  integer  < x. 

* 

Proof : Since  Sq  is  the  optimal  depot  stock,  we  have 

TC (S*)  - TC (0)  £ o 

Thus,  CRS*  + TCL* (S*)  - TCL*(0)  0 

* v * * * 

From  the  Lemma  we  have  that  TCL  (0)  > TCL  (S  ) > TCL  («)  and  hence 

— o — 

* TCL*  (0)  - TCL*  (°o) 

“ 1 CH 


Since  Sq  must  be  an  integer  we  have  the  desired  result. 


Corollary:  Let  S be  such  that  TC(3)  < TC(0)  - TCL  (0) 


* ,TCiS).-_ 

o — C, 


TCL*  («.) 


m 


provides  a better  bound  than  (7)  . 

Proof:  This  follows  as  in  the  proof  of  Theorem  1 since 

TC(S*)  - TC (S)  - C„S*  + TCL* (S*)  - TC(S)  < 0 
o Ho  o — 

Note  that  the  bound  (8)  holds  for  any  S = 0,  1,  2,....  However,  (8)  will 
be  less  than  (7)  if  and  only  if  TC(S)  < TC(0). 

k 

We  note  as  a consequence  of  the  Lemma  that  TCL  («)  in  (7)  and  (8)  may 
* * 

be  replaced  with  TCL  (k)  as  long  as  k > S . Computational  experience  has 

— o 

indicated  that  the  delay  experienced  at  the  depot  by  an  arriving  unit 
decreases  to  zero  rapidly  as  the  depot  stock  level  is  increased  beyond  the 
value  of  the  demand  at  the  depot  during  a repair  cycle.  We  replaced 

ff  ff 

TCL  (<*>)  by  TCI,  (k)  for  values  of  k that  we  felt  were  surely  greater  than 
* 

So«  For  example,  we  used  values  for  k equal  to  two  times  the  depot  lead 
time  demand  and  another  value  of  k equal  to  5 + 1.1  times  the  depot  lead 

k 

time  demand.  However,  it  was  noted  that  the  TCL  (k)  for  these  values  of 

k 

k were  not  significantly  greater  than  TCL  (®)  and  the  bounds  (7)  and  (8) 
were  not  significantly  improved.  In  fact,  computational  experience  has 

k k k 

indicated  that  TCL  (j)decreases  more  rapidly  for  j <_  Sq  than  for  j > Sq. 

This  result  is  not  surprising.  We  would  expect  that  adding  more  and  more 
* 

depot  stock  above  Sq  should  have  a decreasing  affect  on  the  optimal  lower 
echelon  stock  levels  and  costs  due  to  the  rapid  decrease  in  delay  at  the 
depot.  Hence,  in  most  computational  procedures,  we  see  no  real  advantage 

k 

in  replacing  TCL  (®)  in  (7)  or  (8). 

As  mentioned  in  the  previous  section,  the  non-convexity  of 

the  minimization  problem  generally  requires  that  various  depot  stock  levels 

be  explicitly  examined.  When  solving  problem  (6)  for  a particular  value 

of  S it  would  be  convenient  to  be  able  to  use  information  obtained  from 
o 

previous  calculations  with  other  trial  values  of  Sq.  We  now  establish  an 
upper  bound  on  the  amount  of  stock  available  for  distribution  to  the  low<-- 
echelons  in  an  optimal  solution.  Let 

<ff 

LEHC  (k)  = optimal  lower  echelon  holding  cost  when  Sq  = k 

k 

LEBC  (k)  * optimal  lower  echelon  backorder  cost  when  Sq  = k 


7 


I 


so  that  TCL*(k)  = LEHC* (k)  + LEBC* (k) . Let  LES*(k)  = LEHC* (k) /C„  = 

n 

optimal  total  stock  at  all  the  lower  echelon  locations  when  Sq  «■  k. 

Theorem  2: 

(9)  LES* (k)  £ [TCL*(k-l)/CH] 

Proof:  By  the  Lemma,  TCL  (k)  <_  TCL  (k-1) 

LEHC* (k)  + LEBC* (k)  <_  TCL*  (k-1) 

LES* (k)  < TCL* (k-1) /Cu 

Corollary:  LES  (S  ) < [TCL(0)/C„1.  In  fact,  if 
O — H 

k <_  S*  then  LES(S*)  <_  [TCL(k)/CH] 

| 

The  bound  (9)  is  extremely  useful  when  allocating  stock  among  the 
lower  echelons.  Any  allocation  where  the  lower  echelon  stock  allocated 
exceeds  (9)  can  be  ignored.  Note  that  from  (9)  we  have  that 

LES*  (k)  <_  LES*  (k-1)  + [L--^  (‘k~1^)  ] 

CH 

so  that  when  (k  1)_^  a the  total  9tock  allocated  to  the  lower 

j echelons  will  not  increase  as  depot  stock  goes  from  k-1  to  k.  However, 

this  will  not  always  be  the  case  as  one  can  construct  examples  where  lower 

echelon  stock  will  increase  as  Sq  goes  from  k-1  to  k. 

Assume  in  (6)  we  are  examining  a particular  value  of  S . Set  the 

o 

stock  at  all  the  level  two  through  level  n-1  locations  at  values  higher 

than  the  values  of  the  stock  levels  at  these  locations  in  an  optimum 

solution.  By  doing  this  we  have  established  resupply  times  to  the  level  1 

locations  T^(So),  i « 1,2 m^  that  are  lower  bounds  on  the  actual 

optimal  resupply  times  given  depot  stock  is  S . Given  the  T . (S  ) as  the 

o — 1 o 

resupply  times  we  may  calculate  the  stock  levels  for  the  level  1 locations 

S. (S  ) that  would  be  optimal  if  T. (S  ) were  the  actual  resupply  times.  Clearly, 
— l o — 1 o 

the  S1(Sq)  are  lower  bounds  on  the  actual  optimal  stock  at  the  level  1 

8 


x TCL(O) 

locations  when  depot  stock  is  S . If  E S. (S  ) > [ — - — -]  then  this 

0 i-1  ° CH 

particular  value  of  depot  stock  cannot  be  optimal.  One  can  employ  this 

* 

argument  in  a routine  to  determine  a lower  bound  on  S . If  for  S - y 

oo 

TCL(O) 

we  have  £ S , (S  ) > [ „ ■*■] , then  for  any  j < y we  must  also  have 

i=l  ^ ° CH 

ttl 

£ S.(j)  > since  T,(j)  > T (y) . Hence,  using  a bisection  type 

i-1  1 CH  * 

approach  one  can  find  a lower  bound  on  Sq.  There  is  a tradeoff  between 

the  computational  cost  of  performing  a search  for  a lower  bound  versus  the 

cost  of  examining  more  depot  stock  levels  explicitly.  Generally,  high 

demand  situations  where  the  demand  at  the  depot  during  a repair  cycle  is  large 

* 

seems  to  be  the  only  instances  where  establishing  a lower  bound  on  Sq  may  be 
advantageous . 

3.  Constrained  Problems 

The  computational  bounds  developed  above  can  be  used  in  problems  similar 
to  (4).  Consider  (4)  with  a constraint  on  the  total  number  of  units  that 
can  be  held  (or  equivalently  a budget  constraint) . The  new  problem  would 


(10)  Min  C„  S + £ C„S,  + C (£  (£  (x-S  )p(x|x,T  ))) 

H ° j-1  H i B k-1  x>sk  k k k 

N 

S + £ S.  < „ 

° j-1  J “ 

By  introducing  a Lagrange  multiplier,  0 > 0 (10)  becomes 


Min  + I CHS  + Vz  < ‘ (»-Sk)p(x|xtTk)» 


+6  (Sn  + z S.) 
° j-1  J 


Note  for  a fixed  0,  (11)  is  equivalent  to  (4)  where  the  holding  cost  for 
a unit  has  changed  to  C^  +0  . Hence,  in  order  to  solve  (10)  one  first  solves 
the  unconstrained  problem.  If  the  total  optimal  stock  in  the  unconstrained 
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solution  is  ^ y then  we  have  an  optimal  solution  to  (10) . If  the  total 
stock  allocated  exceeds  y,  then  we  form  the  Lagrangian  (11)  and  solve  this 
problem.  Solutions  to  (11)  for  particular  values  of  e yield  undominated 
solutions  and  0 may  be  varied  to  obtain  a satisfactorily  close  solution 
to  (10). 

Another  constrained  problem  considered  by  authors  [1]  is 
ml 

(12)  Min  I z (x-Sk)p(x|xkTk) 

k=l  x>S, 
k 

N 

S + I S.  < y 
° k-1  j - 

The  constraint  in  (12)  always  holds  at  equality.  By  introducing  a Lagrange 
multiplier  0 >_  0,  we  obtain  a problem  similar  to  (4)  but  with  the  "holding  cost" 
of  the  item  now  defined  to  be  0.  Hence,  the  bounds  obtained  can  be  used  in 
solving  these  types  of  problems  as  well. 

4.  An  Algorithm  for  Solving  Problem  (4) 

In  this  section  we  describe  an  algorithm  for  solving  an  n echelon  prob- 
lem. The  algorithm  takes  full  advantage  of  the  computational  bounds  of 
Section  2. 

We  first  fix  the  depot  stock  at  some  value,  say  Sq  = y.  When  the  depot 
stock  is  fixed,  the  resupply  times  for  all  the  level  n-1  locations  have  been 
determined.  What  remains  is  a number  of  n-1  echelon  subproblems.  The 
"depot"  in  each  of  these  subproble-ns  is  a level  n-1  location  in  the  original 
problem.  Hence,  the  results  of  the  previous  section  apply  to  these  new 
"depots".  We  solve  these  subproblems  in  the  same  manner  as  we  solve  the 
original  problem.  We  fix  the  stock  at  the  new  "depots"  and  this  stock, 
along  with  the  fixed  stock  at  the  original  depot,  now  determine  the  resupply 
times  for  all  the  level  n-2  locations.  We  now  solve  a number  of  n-2  echelon 
subproblems.  We  continue  in  this  manner  until  we  are  left  with  a number 
of  two  echelon  subproblems  which  can  be  solved  efficiently  (see  Kruse  [2]). 

Once  we  have  obtained  the  solution  to  the  two  echelon  subproblems , we 
work  backwards  and  obtain  a solution  to  the  three  echelon  subproblems  by 
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explicitly  examining  different  stock  levels  on  the  third  echelon.  When 

the  three  echelon  subproblems  are  solved  we  continue  working  backwards 

solving  the  four  echelon  subproblems,  etc.  until  the  n-1  echelon  subproblems 

have  been  solved.  We  then  have  a solution  to  (6)  for  S » y. 

o 

The  importance  of  the  bounds  derived  in  Section  2 can  now 
be  easily  seen.  In  solving  a typical  n echelon  problem,  a number  of  n-1 
echelon  subproblems  needs  to  be  solved.  Each  of  these  involves  the 
solution  of  a number  of  n-2  echelon  subproblems,  etc.  Clearly,  even  for 
one  value  of  depot  stock  a potentially  large  number  of  subproblems  need 
to  be  solved.  Hence,  good  bounds  on  optimal  stock  levels  are  useful  tools 
in  reducing  the  execution  time  of  a computer  program  solving  an  n echelon 
problem. 

To  clarify  the  solution  procedure  we  present  a complete  algorithm  for 
a four  echelon  problem. 

* 

Step  1:  Set  S - °°  and  solve  three  echelon  subproblems  to  get  TCL  (°°) . 
o 

^ * 

Step  2:  Set  S *0  and  find  TCL  (0).  Set  TCL  (0)  as  incumbent 

O 

minimum  solution  and  save  stock  values. 

Step  3;  Calculate  an  upper  bound  on  Sq  using  (7).  Set  j ° 1. 

Step  4:  If  J > upper  bound  go  to  step  7.  Otherwise,  determine  bound 

on  total  stock  available  for  distribution  to  lower 

* *, 
echelons  ( ■ TCL  (J-l) /C^) and  find  TCL  (j). 

'ft  ft 

Step  5:  If  TCL  (j)  + C j < incumbent  set  incumbent  to  TCL  (j)  + 

H * 

C^  j and  save  stock  levels.  Update  the  upper  bound  on  Sq 
using  (8) . 

Step  6:  Set  j - j + 1 and  go  to  step  4. 

Step  7 : Print  out  optimal  solutions. 

To  solve  the  three  echelon  subproblems,  we  use  the  same  algori„im  as 
above  with  the  word  three  replaced  by  two. 

The  logic  used  in  the  algorithm  can  be  extended  similarly  to  include 
any  number  of  echelons. 
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5.  Extensions 


For  ease  of  exposition  we  have  assumed  that  primary  demands  occur 
only  at  level  1 locations.  This  restriction  can  easily  be  removed.  Let 
W be  the  set  of  all  locations  at  which  primary  demands  occur.  Then  problem  (A) 
becomes 


N 

Min  Z = C„S  + Z CUS, 

H ° j-i  H i 


+ CR  ( Z Z (x-S . )p (x | X . T . ) 
B jE  W X>Sj  i j j 


TheX  , geW  calculated  in  (2)  need  to  be  updated  reflecting  the  fact  that 
removals  many  occur  at  higher  level  locations. 

Conceptually,  one  can  view  higher  level  locations  at  which  removals 
occur  as  consisting  of  two  parts  - an  operating  activity  and  a repair 
activity.  At  the  operating  activity,  the  items  are  used  and  hence  fail. 

The  repair  activity  repairs  failed  items  from  the  operating  activity  and 
failed  items  that  are  sent  by  lower  echelon  locations.  It  is  not  hard  to 
see  that  it  could  never  pay  to  designate  stock  at  such  a location  just  for 
use  by  the  operating  activity.  Hence,  all  stock  at  such  a location  is 
assigned  to  the  repair  activity.  Thus,  every  demand  at  the  operating 
activity  is  backordered.  However,  if  the  repair  activity  has  a serviceable 
unit  on  hand,  resupply  is  instantaneous.  Otherwise,  the  resupply  time  is 
Just  the  expected  delay  until  a serviceable  unit  becomes  available  at  the 
repair  activity  since  all  resupply  to  the  operating  activity  comes  from  the 
repair  activity. 

If  we  let 


X j ■ removals  at  level  k 2)  location  j operating  activity 


X , - Z r(y  ,k)\ 

J ye  N(J,k)  y 


R 1 2 

X j • Xj  + Xj  - average  yearly  demand  at  the  repair  activity 


12 


Then  problem  (4)  can  be  ’written  as 


Min  2 + CHSo  - 


+ c_  ( z l (x-S,)p(x|x.T.)) 


j»l  x>S 


'"j  r 


jeW/{l,2,...m1} 

A 

where  Tj  = resupply  time  for  the  operating  activity  at  location  j ■ expected 
delay  at  the  repair  activity  of  location  j before  a serviceable  unit  becomes 
unavailable 


, z (x-s  )P(x|xJr.)) 

VsC  j J J 


The  bounds  developed  in  section  (3)  can  be  applied  to  this  problem  with 
minor  modification. 

6 . Summary 

In  this  report  we  have  presented  some  useful  bounds  on  optimal  stock 
levels  in  multi-echelon  maintenance  systems.  The  bounds  were  then  in- 
corporated into  an  algorithm  for  solving  a specific  n echelon  problem. 

The  true  usefulness  of  the  bounds  depends  heavily  on  the  specific  problems 
being  investigated.  Furthermore,  in  specific  problems  other  factors  may 
be  present  that  provide  bounds  on  the  optimal  stock  levels.  However,  in 
most  problems  we  feel  the  bounds  presented  here  are  extremely  useful  and 
they  have  already  been  successfully  Implemented  on  some  multi-echelon 
maintenance  problems.  In  the  Appendix,  we  present  a computing  listing 
of  the  Multi  Echelon  Stockage  Subroutines  (MESS)  developed  at  the  US  Army 
Inventory  Research  Office.  The  listing  is  a wording  of  the  algorithm  in 
Section  4 assuming  that  the  mean  demand  at  each  level  1 location  is  the 
same  and  that  a level  k-1  location  can  send  a failed  item  only  to  a level  k 
location  for  repair  if  it  does  not  repair  the  item  at  its  own  repair  facility. 
These  restrictions  can  easily  be  removed  and  the  extensions  of  Section  5 
easily  Incorporated  to  make  the  program  more  robust. 
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